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The  Information  Systems  Laboratory  of  The  Moore  School  of  Electrical 
Engineering,  Unive  'ity  of  Pennsylvania,  was  established  in  1%2  to  develop 
a  design  for  a  tnec  ilzed  information  system  in  the  information  processing 
field,  with  special  attention  to  the  implementation  criteria  entering  into 
on-line  retrieval  through  man-machine  dialogue  from  a  remote  console.  The 
program  is  currently  concentrating  upon  four  major  tasks  at  the  system  level 
specifications  for  capturing  search  strategies;  specifications  for  machine 
storage  of  indexer  aids,  including  lists  of  index  items,  synonymic  equiva¬ 
lences,  classification  tables,  and  other  semantic  tools;  organization  of 
disk  file  storage  to  accommodate  system  routines  for  the  load  and  quest 
modes;  and  study  of  uses  of  graphic  display.  The  search  mode  has  been 
implemented  in  minimal  form  and  informal  tests  have  been  run.  The  long- 
range  goal  is  to  provide  for  machine -directed  search,  with  computer-aided 
instruction  on  how  to  conduct  a  search,  and  with  the  search  conducted  in  a 
problem-solving  mode. 

Out  of  the  early  reflections  on  the  problems  of  indexing  documents, 
Moore  School  conviction  grew  that  information  system  problems  stem  primarily 
from  the  limitations  and  complexities  of  natural  language  as  a  means  for 
comnunication.  These  convictions  have  been  reinforced  as  the  research 
advanced.  The  many  attempts  made  by  other  researchers  to  mechanize  the 
indexing  process  underscore  these  difficulties  and  suggest  that  they  result 
partly  from  the  multitude  of  synonymic  alternatives  and  homographic  ambig¬ 
uities  that  pervade  natural  language,  and  partly  from  the  omission  of  pre¬ 
sumed  common  knowledge  where  the  author  presupposes  that  the  reader  will 
supply  the  broad  framework  of  underlying  material. 

It  follows  that  conventional  schemes  for  cataloging  and  indexing  are 
inherently  limited  in  their  ability  to  assist  the  search  process.  The  newer 
procedures  employ  "deep  indexing"  techniques,  whereby  a  substantial  number 
of  index  terms,  often  as  many  as  100,  are  assigned  to  each  document  to 
supplement  conventional  bibliographic  elements  such  as  author,  title,  date, 
publisher,  etc.  As  used  here,  an  index  term  means  a  single  word,  number, 
or  symbol  or  a  brief  phrase,  which  gives  a  clue  to  a  substantial  topic  or 
item  discussed  in  a  document  or  denotes  a  subject  area  relevant  to  the 
document's  contents. 

The  procedure  which  currently  enjoys  the  greatest  popularity  makes 
use  of  an  "authority  list"  or  "thesaurus"  of  index  terms.  The  thesaurus 
is  prescribed  by  a  group  of  experts  in  the  subject  specialty.  These 
experts  select  a  set  of  (relatively)  independent  index  terms  to  span  the 
topics  that  they  believe  should  be  included  in  the  document  file.  The 
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primary  limitation  of  a  thesaurus  is  that  it  presupposes  an  arbitrary  and 
fixed  characterization  of  subject  matter;  indexing  is  thus  restricted  to 
these  preconceived  notions,  and  new  ideas  are  withheld  from  the  searcher. 

From  the  vantage  point  of  information  theory,  a  thesaurus  restricts  the 
apparent  growth  of  the  file  to  an  accumulation  of  more  and  more  documents 
on  the  same  subject  matter  through  extension  of  ideas  beyond  the  boundaries 
evicting  at  thesaurus-making  time. 

The  Moore  School  research  team  has  therefore  concentrated  upon  the 
preparation  of  a  functional  and  procedural  plan  for  a  mechanized  information 
system  which  recognizes  the  limitations  of  index  terms,  whether  taken  freely 
from  natural  language  or  limited  to  a  prescribed  thesaurus.  The  system 
calls  for  computer  aid  not  only  in  searching  the  document  file  but  also 
in  providing  instructions  on  how  Che  file  has  been  organized,  what  index 
term  meanings  were  assumed  by  the  indexers  at  indexing  time,  which  homo¬ 
graphic  meanings  of  index  terns  are  allowed  by  the  system;  which  synonyms 
are  recognized,  etc.  In  short,  a  "librarian"  is  built  into  the  system  and 
the  user  can  obtain  the  librarian- like  assistance,  in  real  time,  directly 
through  his  on-line  console. 

More  specifically,  the  system  is  planned  with  the  following  features: 

(1)  the  user  lias  direct  access  to  the  system  via  on-line  console; 

(2)  in  addition  to  catalog  and  index  data,  the  system  will  store 
a  complete  description  of  itself; 

(3)  the  user  will  be  perm,  ted  an  unrestricted  search  vocabulary. 

It  will  be  the  responsibility  of  the  system  to  interpret 
search  terms,  request  clarification  where  ambiguity  arises, 
and  provide  meanings  of  terms  upon  request; 

(4)  the  user  will  gain  access  to  the  document  file  through  any 
one  or  more  of  a  large  number  of  entry  ports,  such  as 
author,  data,  color  of  document,  language,  etc.; 

(5)  the  user  will  be  able  to  search  from  an  initial  category 
through  related  categories,  with  assistance  provided  by 
the  system  in  designating  and  locating  related  categories, 
terms,  and  other  entries. 

The  mechanized  Information  system  has  been  implemented  in  its  first 
form.  The  system  has  been  designed  with  a  modular  structure  in  order  that 
commands  may  be  added  with  ease  and  general-purpose  routines  may  be  shared 
by  commands.  The  mass  store  is  an  IBM  1301  d'ek  storage  unit  accessed 
from  an  IBM  7040  computer.  The  Jobs  of  editing,  printing,  and  accepting 
messages  from  local  or  remote  users  are  performed  by  a  DEC  PDP-8, 

Direct  on-line  console  access  is  through  a  33-ASR  Teletypewriter;  remote 
stations  utilize  the  same  model  Teletype  units  with  Dataphones  for  telephone- 
line  connection. 
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Stannary  of  Progress  to  Date 

The  procedural  specifications  of  an  information  system  encompass  the 
information  flow  through  tho  system  from  the  moment  that  a  document  is 
retrieved  through  the  intervals  when  the  document  is  indexed,  ingested, 
and  pariodically  retrieved  and  eventually  to  the  time  that  the  document  la 
purged  from  the  system  because  of  its  obsolescence.  The  procedural  specific¬ 
ations  reflect  the  actions  of  individuals  and  group;  in  processing  the  docu¬ 
ments  and  their  characterization  by  index  terms  (including  conventional 
bibliographic  elements,  etc,)  but  Cite  responsibilities  of  individuals  and 
groups  are  generally  spoiled  out  in  the  functional  specifications. 

Figure  1  illustrates  the  information  flow  through  the  system.  Each 
box  indicates  the  function  performed  at  that  point  and  tho  equipment  and/or 
form  of  information  record.  The  first  box  depicts  the  arrival  of  new  docu¬ 
ments  in  hard  copy  form,  their  evaluation  on  the  basis  of  prescribed  criteria 
and  their  acceptance/rejection  as  file  documents.  The  second  box  denotes  the 
indexing  of  accepted  documents  by  human  indexers.  The  original  document  is 
then  transferred  to  the  document  file  (box  3)  in  its  hard  copy  and/or  micro¬ 
image  form. 

The  indexing  sheets  are  forwarded  to  the  console  operator  for  loading 
into  the  mechanized  file  (box  4).  Only  authorized  users  are  allowed  to 
load  new  information  into  the  files:  such  users  are  assigned  special  codes 
to  identify  themselves  to  the  system  and  to  gain  access  to  the  subroutines 
of  the  loading  program. 

Console  keying  is  forwarded  by  Dataphone  communication  line  (box  4) 
from  the  Moore  School  to  the  Computer  Laboratory  elsewhere  on  campus;  since 
commercial  telephone  system  lines  are  being  used,  any  compatible  teletype¬ 
writer  can  gain  access  to  the  system  equally  well.  Indexing  sheets  and 
other  file  updating  information  are  loaded  periodically  on  n  batch  basis; 
this  has  significant  influence  on  the  file  organization  and  the  loading 
programs,  particularly  on  disk  file  rearrangement  procedures. 

Messages  enter  the  computer  system  through  a  buffer  computer  (box  $), 
where  they  are  assembled  and  edited.  Commands  for  message  editing  are 
illustrated  briefly  below,  where  one  may  also  note  the  manner  in  which 
dialogue  is  promoted  in  natural  English  between  man  and  machine  through 
typewritten  responses  from  the  buffer.  When  the  loading  message  and  the 
indexing  terms  have  be-  a  fully  assembled  in  the  buffers,  a  "message  termina¬ 
tion  symbol"  is  keyed  at  the  console  which  initiates  transfer  through  a 
hardware  Interface  into  the  computer/disk  file  system  (box  7). 

The  new  document  index  is  then  automatically  loaded  onto  the  disk  and 
stored  on  magnetic  tape.  Deviations  from  the  standards,  such  as  index 
terms  that  do  not  appear  in  the  descriptor  lexicon,  are  summarized  and 
forwarded  to  the  vocabulary  review  board  (box  9)  where  instructions  are 
generated  for  file  maintenance  and  improvements  (box  10).  The  latter 
include  expansion  of  the  lexicon  of  transients,  promotion  of  transients 
to  free  terms  and  free  terms  to  descriptors,  adjustment  of  spelling  errors, 
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etc.  The  review  board  instructions  are  then  implemented  through  the  console, 
also  In  the  privileged  load  mode. 

Certain  system  statistics  are  summarised  periodically.  Those  Include 
frequency  of  descriptor  usage,  extremely  high  or  low  document  activity, 
difficulties  in  man-machine  dialogue,  etc.  The  sumarizod  statistics  are 
reviewed  by  the  quality  assurance  board  which  writes  instructions  for  nyetem 
modification  including  descriptor  demotion,  document  purging,  and  adjustments 
to  console  conenends  and  the  retrieval  language.  These  instructions  are  also 
entered  via  the  console  in  the  load  mode. 

The  user  gains  access  to  the  system  whan  the  teletypewriter  console  is 
free  for  user  search  (box  11).  The  user  is  only  permitted  to  use  tho  anarch 
mode  to  access  tho  system.  Suggested  system  improvements  can  be  inaertod 
into  his  search  sequerv  but  these  are  simply  stored  on  magnetic  tape  (box  8) 
for  later  review  by  the  quality  assurance  board. 

About  2000  documents  have  been  manually  indexed.  All  have  boen  key¬ 
punched  onto  Hollerith  cards  and  are  loaded  onto  disk  for  search  experiments. 
The  programs  have  been  written  for  deriving  inverted  lists  of  accession 
numbers,  which  facilitate  rapid  retrieval  through  logical  combinations  of 
index  terms.  An  executive  control  system  has  been  written  which  interprets 
search  commands,  corrects  minor  spelling  errors  in  the  soarch  message,  and 
provides  a  number  of  similar  user  services. 

Operation  of  the  system  may  be  better  understood,  at  least  in  part,  by 
reference  to  the  results  of  an  actual  search  displayed  in  Figure  2,  The 
print-out  begins  with  a  succession  of  lines  of  STANDBY}  these  were  typed  by 
the  buffer  computer  at  one-minut*  intervals  to  assure  the  searcher  that  his 
console  wns  still  connected  but  that  the  IBM  7040  had  not  yet  been  turned 
over  to  the  oystem  by  the  Computer  center  personnel.  Possession  is 
finally  indicated  by  the  buffer  notification,  I  AM  ;*>  . 

The  searcher  gave  his  code  number  (indicating  character  erasure  with  a 
left  arrow)  and  the  buffer  requested  mode  designation.  SEARCH  was  recognized 
as  an  existing  mode,  and  the  searcher  was  permitted  to  proceed. 

The  searcher  requested  a  combinational  search  (keyword:  COMBINE)  on 
four  terms,  three  of  which  were  descriptors  ($B)  and  one  a  date  ($A2), 

After  message  printout,  a  correction  was  made  by  the  searcher  who  added 
another  term  to  the  request.  Finally  after  another  message  printout, 
retrieval  was  implemented  and  the  searcher  informed  of  the  results.  The 
buffer  automatically  asked  if  catalog  data  on  those  documents  were  desired, 
with  "DO  YOU  WANT  TO  SEE  ANY 7" 

Affirmative  response  was  followed  by  a  sequence  of  queries  to  deter¬ 
mine  which  of  the  documents  and  which  catalog  data  were  desired.  Note  that 
the  machine  directed  the  searcher  at  this  point.  In  fact,  the  searcher 
was  interested  in  accession  numbers  only,  and  all  37  he  requested  were 
printed  out. 


In-  che  tuxc  tnan-ixichino  dialogue  (Figure  2c),  die  RETRIEVE  command 
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was  employed,  allowing  for  any  logical  combination  of  request  terms.  The 
union  of  documents  by  two  authors  was  requested,  and  again,  the  searcher 
was  directed  to  specify  catalog  data  desired.  Note  that  the  searcher 
misspelled  RETRIEVE  and  was  corrected.  As  soon  as  format  was  determined 
the  machine  printed  out  two  documents.  More  could  have  been  obtained  i  / 
answering  YES  to  the  machine  query  MORE?. 

In  the  last  dialogue  (figure  2d),  the  DISPLAY  command  was  used  in 
order  to  have  certain  catalog  data  of  specific  documents  printed  out.  The 
rest  of  the  dialogue  should  be  self-explanatory.  The  message  END  terminated 
the  connection. 


Easy  English 

The  commands  RETRIEVE  and  COMBINE  illustrate  the  operation  and 
behavior  of  Symbolic  Command  Language  (SCL)  as  a  means  for  man/machine 
communication  through  a  typewriter  console,  SCL  proved  satisfactory  for 
users  of  the  information  system  who  participated  in  the  study  or  who 
happened  to  wander  in  during  demonstrations.  It  wa3  therefore  decided  to 
perform  an  experiment  with  a  more  universal  set  of  subjects  who  were  less 
skilled  with  mathematics  and  computer  languages  than  the  study  participants 
and  casual  visitors.  The  new  subjects  consisted  of  secretaries  and  under¬ 
graduate  students,  and  their  poor  results  deflated  the  confidence  in  SCL 
that  had  been  building  up. 

A  far-reaching  action  was  then  taken,  to  leapfrog  ahead,  rejecting 
all  artificial  languages  and  turning  instead  to  a  somewhat  restricted  but 
nevertheless  real  version  of  English.  Fortunately,  as  mentioned  above, 

SCL  was  designed  in  modular  form  and  it  has  been  found  possible  to  sat  the 
new  command  language,  '’Easy  English",  directly  over  the  top  of  SCL  which 
it  then  uses  for  the  actual  search.  The  following  is  a  summary  description 
of  the  new  command  language,  which  has  been  fully  operational  since 
February  1967, 

Easy  English  is  a  plain  command  language  designed  to  simplify  dialogues 
between  man  and  machine  through  a  remote  typewriter  console.  It  is  made  up 
of  readily  recognized  sentences  of  the  English  language,  sentences  which  any 
layman  might  be  expected  to  use  In  everyday  requests  for  services  or  articles 
from  a  familiar  source.  Easy  English  has  been  developed  as  a  command  language 
for  retrieval  of  documents  from  a  computerized  data  base,  specifically  from 
the  Moore  School  Information  Systems  Laboratory  (MSISL)  files.  It  is  Intended 
for  all  information  retrieval  systems  using  remote  typewriter  consoles  ir  a 
conversational  mode. 

Easy  English  is  imbedded  in  the  MSISL  retrieval  program  which  provides 
computer-directed  search,  computer-aided  editing,  and  other  forms  of  computer 
assistance.  The  attached  typewriter  printout  presents  a  typical  man-machine 
conversation  which  illustrates  Easy  English  along  with  a  number  of  feature® 
of  the  Laboratory  retrieval  system.  Note  that  the  latter  currently  provides 
the  option  of  translation  of  the  Easy  English  request  into  Symbolic  Command 
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Language  while  searching  the  files;  this  is  a  convenience  for  those  who  might 
like  to  learn  Symbolic  Command  Language  on  their  own  and  use  its  shorter  but 
more  formal  statements  in  place  of  Basy  English. 

Because  Easy  EngHah  is  in  fact  real  English,  the  only  thing  that  the 
searcher  needs  to  learn  is  that  requests  for  information  from  the  system 
should  be  formulated  in  the  following  syntactical  form: 


Introductory  Clause  Document  Clause  Data  Clause 


The  following  sentences  present  five  forms  in  which  the  9ame  retrieval 
request  can  be  phrased  in  Easy  English. 

(1)  PLEASE  LOCATE  EVERYTHING  WRITTEN  BY  ROBERT  PERKINS  ABOUT  EASIAC  OR 
PSEUDO-COMPUTERS  BETWEEN  1955  AND  1959  <  > 

(2)  COULD  YOU  FIND  FOR  MB  SOMETHING  CONTAINED  IN  THE  REPOSITORY  CONCERNING 
EASIAC  OR  PSEUDO-COMPUTERS  THAT  WAS  AUTHORIZED  BY  ROBERT  PERKINS  AFTER 

1954  AND  BEFORE  1960  <  > 

(3)  I  NEED  ALL  THE  AVAILABLE  DOCUMENTS  PUBLISHED  DURING  THE  PERIOD  1955  TO 
1959  BY  ROBERT  PERKINS  ON  THE  SUBJECTS  OF  EASIAC  OR  PSEUDO-COMPUTERS  <  > 

(4)  WE’RE  INTERESTED  IN  HAVING  REFERENCES  AND  MATERIAL  ON  EITHER  PSEUDO¬ 
COMPUTERS  OR  EASIAC  AUTHORED  BY  ROBERT  PERKINS  FROM  1955  TO  1959  <  > 

(5)  I  WOULD  LIKE  YOU  TO  HELP  ME  OBTAIN  INFORMATION  FROM  YOUR  LIBRARY  RELATED 
TO  EASIAC  OR  PSEUDO-COMPUTERS  AND  WRITTEN  BY  ROBERT  PERKINS  IN  THE  YEARS 

1955  THROUGH  1959  <  > 

Notice  that  despite  the  differences  in  vocabulary,  all  of  these  statements 
follow  the  same  basic  pattern;  for  example, 


COULD  YOU  FIND  FOR  ME  SOMETHING  CONTAINED  IN 

THE  REPOSITORY  CONCERNING  . , . 


Typical  examples  of  phrases  acceptable  in  the  three  clause  categories 

are: 

Introductory  clause 

(1)  I  would  like  ... 

(2)  Please  find  for  me  ... 

(3)  I  have  need  of  ... 

(4)  I  desire  . . , 


12. 


Document  clausa 


(1) 

(2) 

(3> 

(4) 

(5) 


. .  documents  In  the  system  ... 

. .  information  ... 

..  any  available  book  or  article  in  the  repository  ... 
. .  references  from  the  files  ... 

..  all  the  stuff  ... 


Data  clause 

(1)  ...  written  by  Carr  between  1958  and  1965. 

(2)  ...  published  in  1960  on  information  retrieval 
and  word  association  but  not  programming. 

(3)  ...  dated  September  1966  by  J.H.  Smith,  Joe  Doe 
but  not  K.L.  Jones  about  analog  computers. 


In  the  event  that  a  word  appearing  in  either  the  introductory  or  the 
document  clause  is  not  recognized,  the  computer  initiates  a  man-machine 
dialogue  in  order  to  determine  whether  the  word  la  essential  and,  if  so, 
to  seek  out  a  synonym  in  its  vocabulary.  Examples  of  such  dialogues 
appear  on  the  attached  typewriter  printout. 


Current  Tasks 

With  the  system  operational  in  its  first  form,  attention  has  been 
directed  to  accommodation  of  the  many  other  features  Implied  by  the  pro¬ 
cedural  flow  chart  in  Figure  1.  A  number  of  tasks  have  been  defined  and 
are  described  below.  Documentation  of  the  mechanization  to  date  has  been 
initiated  on  three  levels:  detailed  microflowcharts,  programs,  and  related 
descriptive  text;  macroflowcharts  and  related  text  describing  the  gross 
features  of  the  system  and  showing  the  interrelationships  among  the 
detailed  programs;  and  brief  summaries  of  the  main  features  of  the  system, 
cross-referenced  to  the  macroflowcharts. 

As  mentioned  above,  the  Moore  School  information  system  plan  calls 
for  computer-aided  search.  The  basic  tactic  for  computer  aid  is  a  sophisti¬ 
cated  use  of  man-machine  dialogue  in  a  problem-solving  mode.  The  system 
incorporates  computer-aided  instruction  as  a  means  for  assisting  the  searcher 
to  find  not  only  information  about  the  document  file  but  also  information  on 
how  to  go  about  the  search,  i.e,,  computer-aided  instruction  on  computer* 
aided  search.  At  the  same  time,  the  Moore  School  recognizes  the  services 
provided  by  conventional  bibliographic  tools,  and  particularly  those  which 
expedite  search  through  condensed  display  of  bibliographic  coupling.  The 
tasks  reflect  this  broad  range  of  information  system  support. 


The  tasks  may  be  delineated  in  the  following  order,  proceeding  from 
the  simplest  aids  to  the  most  advanced: 


.  Syntactic  Tools 
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YOU  MAY  PROCEED- !-  •  PLEAW~$K  F 1 ND  EON  ME  HOOKS 

CONCERNING  STATISTICAL  FUNCTIONS  OK  STANDARD  f  Message  1* 

DEVIATION/  OUT  NOT  BUSINESS  ORIENTED  ZILKS  \  entered, 

JNC***ENT|TL£0  ’RUNCIBLE* *!'♦<> 

♦  «  • 


PRINT?  1=  YESo 


YOUR  MESSAGE  IS: 

0  1)  PLEASE  FIND  FOR  ME  BOOKS 

02)  CONCERNING  STATISTICAL  FUNCTIONS  0;R  STANDARD 
03)  DEVIATION/  BUT  NOT  BUSINESS  ORIENTED  ZILKS 
0  4)  ENTITLED  *KUNCI BLE *  •  I  •  ♦ 

•  i  *  » 


r 

Edited  message 
is  printed  out 
with  lines 
enumerated  by 
^  computer* 


CORRECTIONS?  »«  ,  YES<> 


LINE  Nw.  tc  3<> 

,  L1NE(S): 

DEVIATION/  8UT  NOT  BUSINESS  ORIENTED**  JA  llne  i# 

l  changed. 


MORE?  :»  YE'S<> 


LINE  NO.  i«  0<> 
LINE(S)  i 

DEAR  COMPUTER! <> 


C a  line  is 
added. 


\ 


MORE?  :  =  N0<* 

PRINT?  :=  YE$<> 

i 


YOUR  MESSA6E  IS: 

0  1)  DEAR  COMPUTER! 

02)  PLEASE  FIND  FOR  ME  BOOKS 

03)  CONCERNING  STATISTICAL  FUNCTIONS  OR  STANDARD 
0  4)  DEVIATION/  BUT  NOT  BUSINESS  ORIENTED 
0  53  ENTITLEO  *RUNCI  BLE*  'I  '  . 


flhls  is  the 
?  final  request 
|^in  Easy  English. 


CORRECTIONS?  i~  N0<* 

WE  bib  NOT  RECOGNIZE  TKE  WORD  DEAR 
rnrrl~WeT MEANING  OF  YOUR  SENTENCE?  i  - 


*  I  S  THI  S 
NQ«> 


WORD  ESSENTIAL  TO _ 

A  non-esscnti.il 
word  is  challenged 
and  chen  ignored. 


14. 

WE  I'tl)  NOT  RECOGNIZE  THE  KOMI)  COMPUTE/?  .1$  Till  «  WORD  ESSENTIAL  TO 

THE  .MEANING  OF  YOUR  SENTENCE?  .*«  NO<t 
•  * 

RETRIEVE  <  $0  <  < STATI STI CAL  FUNCTIONS  fsymbollc 

>  4  (STANDARD  DEVIATION  .  )  )  Cotmannd 

>  *  {BUSINESS  0R1  ENTED  >  J Language 

>  £  <  SAD  RUNC1DLE  1  ^Equivalent 

% 

000001  ’REFERENCES*  HAVE  BEEN  RETRIEVED. 

4  fr 

YOU  MAY  PROCEED,  ts  PLEASF,  GET  BOOKS  BY****WRI  TTEN/  EDI  TEOYAnother 

‘  OR  PUBLISHED  DY  CARR.o  ^request  in 

^Eaay  English. 

PRINT?  »e  NO<> 

RETRIEVE  <  <  SA1  CARR  «  ♦  SA A  CARR  > 

♦  <  $A5  CARR  >  > 

•  i 

000009  ‘REFERENCES*  HAVE  BEEN  RETRIEVED. 

*  ♦ 

PRINT  SOME?  l«  N0<v 

YOU  MAY  PROCEED. i ~  GET  BOOKS  BY  EITHER  CARR  OR  RU8IN0FF  (a  Third 
BUT  NOT  BY  CARRo  \request. 


PRINT?  ««  NO<> 


RETRI  EVE 
MUBINOFF 
> 


<  $A! 

>  ) 


CARR  > 

<  SA!  j CARR 


0  000OI  'REFERENCES*  HAVE  8EEN  RETRI EVEO. 


YOU  MAY  PROCEED. t »  OBTAIN  FOR  ME  BOOKS  WRITTEN  IN  1941  <> 

{number  4. 

PRINT?  Je  N0<> 

RETRIEVE  SA2  1961 

000127  ‘REFERENCES*  HAVE  BEEN  RETRIEVED. 

♦  «- 

PRINT  SOME?  NO<> 


YOU  MAY  PROCEEO.Jb  1  WOULD  LIKE  YOU  TO  FIND  BOOKS 
WRITTEN#  E01TE0/  AND  PUBLISHED  BY  CARR.o 

">  » 


PRINT?  »*■  N0<> 

< 


RETRIEVE  <  <  SAt  CARR 

£  <  SA5  CARR  )  ) 

NO  ‘REFERENCES*  HAVE  BEEN  RETRI  EVEO. 


£  SA4  *  CARR 


F I Request  number  5, 
Note  the  ability 
of  the  system  to 
separate  out  the 
author,  editor,  and 
(^publisher  functions. 

> 


15, 


.  Semantic  Tools 
.  Indexer  Aids 
*  Graphic  Display 
.  Adaptive  Interface 
.  Inter system  Switching 
A  few  commence  will  be  made  on  each  item. 

Syntactic  cools  are  those  which  make  use  of  word  associations  or 
author-designated  couplings.  Specific  examples  are  permuted  title  indexes 
(KWIC)  and  citation  indexes.  The  program  to  derive  a  KWIC  index  of  the 
collection  has  been  prepared,  and  citation  index  preparation  has  been 
initiated.  Both  will  be  printed  for  visual  use  in  the  Moore  School  library; 
KWIC  is  automatically  available  in  the  mechanized  system  and  the  citation 
index  will  be  added, 

KWIC  does  not  pretend  to  be  a  sophisticated  cataloging  system,  but 
its  use  in  association  with  a  document  library  has  the  following  advantageo: 

1,  It  is  an  inexpensive  way  to  produce  a  printed  catalog 
of  the  library,  since  it  can  be  automatically  produced 
by  the  system  in  a  format  ready  for  photo  "eduction 
and  offset  printing. 

2.  It  is  easy  to  keep  up  to  •■'ate,  as  the  documents  are 
already  indexed  and  stored  in  the  mechanized  system, 

3.  It  can  be  widely  distributed  in  simple  loose-leaf  or 
book  form. 

4,  It  provides  a  printed  record  of  the  documents  stored 
in  the  system  at  any  time  in  its  development. 

It  is  conjectured  that  a  citation  network,  connecting  every  document 
in  a  library  to  every  other  one  which  cites  it  or  is  cited  by  it,  might, 
be  a  useful  tool.  Various  studies  will  be  made  of  experimental  citation 
networks,  with  the  goal  of  adding  this  tool  to  the  system.  The  citation 
network  might  be  made  directly  available  to  the  user,  so  that  he  may  start 
at  any  document  and  follow  a  trail  of  citations  either  forward  or  backward 
in  hts  document  search.  More  important,  manipulations  of  a  citation  net¬ 
work  may  be  applicable  to  adaptive  interface  techniques  for  unsolicited 
machine  assistance  to  the  searcher. 

Research  has  been  initiated  to  investigate  the  uses  and  effectiveness 
of  word  associations  to  a  greater  depth  than  previously  attempted  by  other 
experimenters.  An  Important  shortcoming  in  earlier  attempts  was  their 
failure  to  distinguish  among  various  types  of  intellectual  coupling  that 
contributed  in  equal  amount  to  the  derived  association  factor.  For  example, 


if  index  terms  (A,  B)  are  strongly  associated,  and  (B,  B)  are  strongly 
associated,  but  (A,  B)  are  weakly  associated,  there  are  at  least  two  inter¬ 
pretations  which  have  opposite  implications  for  information  retrieval.  The 
first  interpretation  is  that  A  and  B  are  synonyms  and  authors  have  subjective 
preferences  for  one  or  the  other.  The  second  interpretation  is  that  S  is  a 
homograph  with  two  different  meanings,  A  and  B,  and  that  the  latter  have  no 
intellectual  ties  whatsoever.  The  first  task  will  be  therefore  to  seek  out 
the  various  intellectual  relationships  that  may  be  associated  with  different 
patterns  of  word  associations. 

It  is  important  to  note  that  word  associations  could  serve  information 
systems  in  a  number  of  ways.  In  establishing  a  system,  word  associations 
readily  lend  themselves  tc  vocabulary  synthesis,  to  document  Indexing >  end 
to  determination  of  relevance  of  a  document  to  the  scope  of  the  file.  In 
system  search,  word  association  lends  itself  to  extension  of  search  scope 
by  searching  on  unsolicited  but  strongly  associated  words. 

Semantic  tools  include  a  number  of  devices,  such  as  sets  of  synonymic 
equivalents,  classification  tables  based  on  a  variety  of  word  relationships, 
and  semantic  expansions.  These  tools  are  applictble  both  to  index  terms  and 
to  system  commands.  Synonyms  are  used  even  on  conventional  thesauri,  but  it 
is  intended  to  expand  their  use  and  provide  automatic  aubstitution  where  use 
of  a  preferred  synonym  leads  to  system  efficiencies.  Classification  tables 
(Figures  3a-3f)  provide  tools  for  browsing  through  the  indexing  structure, 
discovering  relationships  among  words,  branching  between  unrelated  topics 
through  homographic  coupling,  etc.  And  semantic  expansions  provide  explana¬ 
tions  and  illustrations  at  several  levels  of  detail  which  serve  to  instruct 
the  searcher  on  the  meanings  of  words  and  their  mode  of  employment  in  the 
system.  Tor  example,  consider  the  following  semantic  expansion  of  the  des¬ 
criptor  INTERPRETIVE  PROGRAM,  supposing  that  a  searcher  has  asked  that  this 
term  be  explained  for  him  and  that  he  requests  further  explanation  after 
each  of  the  first  three  system  responses.  (Underlining  indicates  that 
explanation  of  the  underlined  term  is  also  available  from  the  system.) 

A.  First-level  response: 

"An  INTERPRETIVE  PROGRAM  is  a  computer  program  chat  combines 
translation  and  execution. " 

B,  Second-level  response: 

"An  INTERPRETIVE  PROGRAM  is  a  computer  program  which  receives 
a  sequence  of  commands  in  a  source  language,  examines  each 
command,  determines  a  translation  to  replace  it  in  the  object 
language .  and  executes  it  if  possible.  The  major  character¬ 
istic  of  an  INTERPRETIVE  PROGRAM  is  that  the  translation  of 
an  instruction  is  performed  each  time  the  instruction  is  to  be 
obeyed." 

C«  Third-level  response: 

"An  INTERPRETIVE  PROGRAM  carries  out  the  instructions  of  a 
program  written  in  one  lan  uage  by  translating  each  instruction 


*upno>j 


uojacHuqimi-opnotM 


9anp900Jta 


»poo  aopao 


a»pao 


3J»ct  uopp4vdo 
SjTunSup' 
p&juojaO-^ujiptfH 


u073(U»dO  WfqoBH 


»»VP3fU9l  »UfllO»H 


uoponjqeui  ouj^OflU 


vupnoa  »Ai39ada«3ul 


J»39.td393Ul 


»poo  uoT3ona3Dui 


aO3»J9H90 


uo-jqouni 


wapnHuo'i 

3U9pu9<l»a'^9qndtooo 


9po0  4»3i'du>o0 


pumwooo 


9UT3nou  Ax<ih»980V  k 


Jt*Tqw*«*V  K 


ICMMI 

■■■hi 


H  H 


SWAN0NA8 


SSEBSBBBEES 

iiioiBliSl 

IbbbbbSbsbbb 


t  e  I 


i>  I  0 

W)  j  *M 


B 

« 

u 

09 

•j  2 

*)  fu 


Hi  w  t-J 


p.  a.  ft,  ft. 


o 


o 


0 


Language 


Program 


Programming 

Language 


CENTRIC -SPECIFIC 

Condensed  Sample?  of  Cla*aific«Uon  Table* 

Figure  3c 


Operation 


Program 


X  X 


NO UN -MODIFIERS 


Condensed  Sample  a  of  Claoeifioution  Table* 
Figure  3e 


Trans 1 a 


21 


of  that  source  language  into  a  sequence  of  computer  instructions 
in  the  language  of  the  computer  being  used,  and  by  allowing  these 
computer  Instructions  to  be  obeyed  before  translating  the  next 
instruction.  This  step-by-step  translation  and  execution  becomes 
significant  when  the  execution  of  one  instruction  causes  a  change 
in  the  meaning  of  that  instruction  or  another  one.  A  new  trans¬ 
lation  of  the  changed  Instruction  will  be  necessary  then  before 
it  can  b»  correctly  executed." 

D.  Fourth-le%rel  response: 

"Consider  the  following  sequence  of  instructions: 

Position 

1 

2 

3 

4 

5 

6 


Instruction 
FETCH  5 
ADD  6 
STORE  5 
CO  TO  1 


An  INTERPRETIVE  PROGRAM  might  first  translate  FETCH  5  into 
24005  ("bring  into  the  accumulator  the  contents  of  memory  position 
5M)  and  execute  the  instruction.  Then  it  might  translate  ADD  6 
into  28006  ("add  to  the  accumulator  the  contents  of  memory  position 
6")  and  execute  that  instruction.  Then  it  might  translate  STORE  5 
into  02005  ("store  the  contents  of  the  accumulator  in  memory 
position  5")  and  execute  that  instruction.  Finally,  it  might 
translate  GO  TO  1  into  32001  ("go  to  the  instruction  located  in 
memory  position  1  and  execute  it").  The  instruction  located  at 
memory  position  1  is  FETCH  5.  Because  the  INTERPRETIVE  PROGRAM 
has  carried  out  all  instructions  immediately  after  translating 
them,  memory  position  5  now  contains  a  new  value  which  will  be 
incorporated  into  all  further  instructions  involving  it.  If 
translation  of  all  instruc tions  had  been  completed  before  any  of 
them  had  been  executed,  such  a  change  would  have  been  ignored. 

This  demonstrates  the  major  characteristic  of  an  INTERPRETIVE 
PROGRAM  that  translation  of  an  instruction  is  performed  each 
time  the  instruction  is  to  be  obeyed." 


While  such  semantic  tools  as  classification  tables  and  semantic 
expansions  were  originally  conceived  and  developed  by  the  Moore  School  as 
searcher  aids,  it  appears  that  they  are  also  necessary  in  the  areas  of 
vocabulary  control  and  document  indexing.  As  mentioned  earlier,  much  of 
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the  search  process  is  dependent  upon  the  quality  of  indexing,  and  indexing 
quality  is  likewise  dependent  upon  the  quality  of  the  thesaurus  from  which 
items  are  chosen.  The  Laboratory  has  concluded  that  research  and  implementa- 
tion  of  semantic  tools  are  necessary  to  the  development  of  better  mechanized 
information  systems.  Figure  4  illustrates  the  role  that  semantic  tools  play 
in  the  interactions  that  exist  among  those  who  devise  and  control  the  vocabu¬ 
lary  and  those  who  use  it  for  indexing  and  searching. 

It  should  be  recalled  that  the  system  aims  to  provide  a  broad  cross- 
section  of  users  with  access  to  the  file  of  documents.  This  requires  a  system 
which  is  self-explanatory  to  a  user  who  has  no  experience  with  a  mechanized 
library,  and  is  only  superficially  familiar  with  usual  library  techniques, 
Including  the  availability  of  a  librarian's  guidance.  The  capability  of 
"carrying  on  a  conversation"  with  the  user  will  explain,  instruct,  volunteer 
suggestions,  and  guide.  These  semantic  tools,  and  especially  semantic 
expansion,  will  Incorporate  ideas  from  the  field  of  programmed  instruction 
(teaching  machines),  specifically  techniques  of  what  is  known  as  "intrinsic 
programing".  At  a  superficial  level  this  means  that  any  user  may  request 
instruction  in  the  use  of  any  or  all  phases  of  the  system.  If  simple 
information  does  not  satisfy  him,  he  may  request  more  detailed  information, 
first  about  the  general  organization  of  the  system,  and  then  about  the  actual 
structure  and  inner  workings  of  any  or  all  of  its  substructures.  "Semantic 
expansion"  techniques  will  afford  the  user  any  degree  of  detail  he  may  desire 
(see  Figures  5a  and  5b  for  a  semantic  expansion  of  the  system  command 
RETRIEVE).  This  feature  of  the  mechanized  system  corresponds  to  a  librarian's 
ability  to  explain  how  a  library  is  organized  or  structured,  either  super¬ 
ficially,  or  in  great  detail. 

At  present,  all  document  Indexing  is  done  manually.  This  Introduces 
the  difficulty  of  searching  for  indexing  terms  that  may  have  been  used  pre¬ 
viously  and  would  serve  again  A  second  difficulty  stems  from  the  delays 
and  errors  introduced  in  the  multi-step  process  of  writing  down  the  index 
terms,  sending  the  indexing  sheets  to  be  keypunched,  listing  the  results 
on  a  high-speed  printer,  and  then  comparing  against  the  original.  Both 
difficulties  can  be  alleviated  by  providing  the  indexer  with  an  on-line 
direct-access  console. 

Initially,  the  mechanized  system  will  be  provided  with  the  capability 
of  accepting  new  document  information  directly  from  the  indexer.  It  will 
request  the  desired  information  item  by  item,  and  it  will  accept  this  infor¬ 
mation  only  in  a  standard  format,  rejecting  ambiguous  entries.  Eventually, 
by  means  of  the  semantic  tools  mentioned  earlier,  the  system  will  assist 
the  indexer  with  his  choice  of  subject  index  and  secondary  index  terms, 
assuring  greater  standardization  of  index  terminology  and  omission  of 
extraneous  material. 

Graphic  display  consoles  offer  many  advantages  over  teletypewriters 
ae  terminal  units.  Currently  in  use  at  the  Moore  School  are  two  Bunker-Ramo 
Teleregiater  consoles  which  allow  character  display  only.  More  sophisticated 
devices,  permitting  diagram  display  and  light  pen  operation  are  currently 
being  developed.  Such  devices  have  great  potential  in  the  information 
laboratory,  as  they  free  the  system  design  from  many  constraints  imposed  by 
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Semantic  Expansion  of  the  Command  RETRIEVE 

CN.B.  Underlining  indicates  that  further  explanation  it  available  from  the 
ayatem  by  specifying  the  underlined  word  or  word  phrase,} 

A.  Firac-level  response: 

"RETRIEVE  is  a  command  used  to  obtain  Information  about  documents  in 
the  data  base,  according  to  the  apecifications  of  a  user  of  the  system," 

B>  Second-level  response: 

"The  RETRIEVE  command  provides  information  about  documents  in  response 
to  given  index  term  specifications.  You  may  specify  the  required 
document(s)  by  bibliographic  data  (  category  $A  with  sector  codes 
$A1  -  $a9  )  ,  descriptors  (  category  $B  ) ,  or  added  information 
(  category  $C  ).  Your  request  will  be  formulated  by  the  following 
logical  combinations  of  your  specifications: 

a)  documents  characterized  by  all  of  the  terms  (and,&) 

b)  documents  characterized  by  at  least  one  term  (or,  +) 

c)  documents  characterized  by  all  of  some  terms  but  not  by  one  or 

wore  other  term*  (and  not,  t). 

Wheniyou  have  given  a  RETRIEVE  command ,  you  will  be  informed  how  many 
documents  have  been  retrieved  and  viD.be  asked  to  specify  the  types 
of  information  (accession  numbers.  $A,  $B,  $C)  yo,u  would  like  to  have. 

The  requested  information  for  each  retrieved  documents  will  then  be 
printed  out." 

C*  Third-level  response: 

"Consider  the  RETRIEVE  command 

RETRIEVE  ($A1  CARR,  J  W  III  +  $B  PROGRAMMING  LANGUAGES)  t  IBM  MANUALS  <  > 

The  machine  will  respond  to  this  instruction  by  finding  the  accession 
numbers  of  all  documents  having  J.  W.  Carr,  III,  as  an  author  ($A1) 
and  "Programming  Languages"  but  not  "IBM  Manuals"  as  descriptors  ($B). 

The  machine  will  type  out  the  number  of  documents  satisfying  these 
conditions,  offer  to  PRINT  SOME?:*  ,  and,  if  your  answer  is  YES,  ask 
which  categories  of  the  documents'  full  description  (accession  numbers, 

$A,  $B,  $C)  you  would  like  to  see.  The  machine  will  then  type  out  the 
appropriate  information  atopping  periodically  to  aak  MORE?;**.  When  you 
anawer  NO  <  >  at  any  time  during  this  sequence  or  when  all  the  requested 
information  has  been  printed  out,  the  machine  will  indicate  readiness  to 
receive  a  new  instructian  with  YOU  MAY  PROCEED:*1* 

D*  Fourth-level  response; 

See  Flowchart  and  Table  for  RETRIEVE  Command. 


Figure  5a 
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Figure  5b 

_ Z!u_ 

Results  following  f  row  actions  (on  left)  under  the  indicated  conditions: 
*Actlons  by  User  or  System  1  Always*"!  Uaer  answer#  or  o 


Always  User  answers  or  oystem  finds: 
Follows  Yesl  No"!  All* I  Forge t* 


.  user  types  RETRIEVE  command  such 
as  RETRIEVE  $Al  RUBINOFF  &  $8  AUTOMATA  <  > 
using  logical  combinations  (<&,  +,  t)  of  Che 
specifications  (author,  title,  index  terns, 
etc,)  of  the  documents  he  needs  with  Che 
specifications  prefixed  by  their  approp- 
riate  category  symbol#  ($Al-$A9,  $B,  $C). 


2,  System  finds  documents  answering 
specifications  of  user. 


5  3 


3.  System  informs  user  that  NO  DOCUMENTS 
HAVE  BEEN  RETRIEVED 


4.  System  types  YOU  MAY  PROCEED. 


5.  System  informs  user  how  many 
documents  have  been  retrieved;  asks 
PRINT  SOME? 


.  User  answer#  question  in  (5). 


7.  System  asks  user  to  specify  desired 
information  categories  by  answering  ques¬ 
tions  about  each  and  asks  user  to  answer 
YES,  NO,  ALL  or  FORGET  to  each  question. 


8.  User  answers  questions  in  (7). 


9.  System  prints  out  the  desired 
information  for  all  documents  found. 


10,  User  answers  question  in  (9). 


Bill 


11,  System  prince  all  desired  infor¬ 
mation  for  all  documents  found. 


12,  System  types  THAT'S  ALL. 


13.  System  prints  out  accession 
numbers  for  all  docuaents  found, 

■  topping  periodically  to  a 9k  MORE? 

\ 


14.  User  answers  question  in  (13). 


15.  System  prints  accession  numbers  for 
all  documents  found. 


*  Condition  applies  only  to  action  0  **  Result  follows  only  if  fiO"  is  only  condition 

Table  (Fourth- level  Response  in  SomanrJn  Expansion  of  RKTRTEVE  fonir.M nrO 
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the  ten-character-per-second  teletype.  On  many  occasion*  in  man-machine 
dialogue,  the  searcher  is  offered  a  choice  among  a  number  of  alternatives, 
eic  i  alternative  leading  to  another  sequence  of  choices,  A  video  con  ole 
allows  simultaneous  display  of  all  alternatives  and  the  wherewithall  for  a 
better  decision.  Furthermore,  text  and  catalog  data  can  be  instantly  die* 
played.  The  light*pen  feature  invites  rapid  reply  by  the  searcher. 
Similarly,  on-line  indexing  is  facilitated  by  display  of  portions  of  micro* 
thesauri  and  classification  tables.  Flowcharts  like  that  in  Figure  6 
replace  the  harder- to-read  tables  (Figure  5b)  in  semantic,  expansions.  These 
and  ocher  advantages  of  graphic  display  will  be  considered  in  the  current 
design  and  implementation. 

"Adaptive  interface”  refers  to  the  system  capability  of  unsolicited 
suggestion  and  assistance  to  the  user.  This  capability  will  probably  be 
comprised  of  a  large  variety  of  techniques  and  will  be  employed  in  many 
modes  of  operation  of  the  system.  It  may  be  compared  to  the  unsolicited 
assistance  offered  by  a  librarian  who  has  come  to  understand  the  problem 
of  a  library  user  through  his  questions.  The  librarian  might  say:  "You 
are  asking  the  wrong  kind  of  questions,  so  let  me  suggest  Much  of 

the  adaptive  interface  technique  will  probably  be  based  on  results  of  the 
study  of  search  strategies  of  various  users.  Pragmatic  experiments  will 
be  set  up.  Choice  of  subjects  will  tAke  account  of  their  background, 
motivation,  and  adaptability  with  respect  to  the  mechanized  system.  Use 
will  be  made  of  the  large  amount  of  literature  in  the  field  of  "artificial 
intelligence",  including  work  in  machine  problem*eolving  and  self-organizing 
systems.  The  work  being  done  in  word  association  and  cltstion  networks  will 
also  come  into  play. 

A  flowchart  delineating  the  organization  and  sequence  of  tasks  is 
shown  in  Figure  7.  Implementation  tasks  sre  supported  by  Army  Research 
Office  (Durham);  system  studies  are  supported  by  the  Air  Force  Office  of 
Scientific  Research. 
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(jL)User  typos  RETRIEVE  command  cv»ch  as 

retrieve  $ai  rubinoit  &  $b  automata  <  > 

using  logical  combinations  (&,  +,  r)  ojC 
the  specifications  (author,  title,  index 
terms,  etc.)  of  the  documents  ho  nccdG, 
with  the  specifications  prefixed  by  their 
appropriate  category  symbols  ($Al-yA9, 

$B,  $C).  , 


rf-  ..  . 

(^System  types 
YOU  MAY  PROCEED 

*  '-1 

f 

(a) System  finds  documents  about  AhTOMAXA 
written  by  RUDINOPF. _ . 

YES 


NO 


s\3/ System  informs  user  that  HO 
'  DOCUMENTS  HAVE  BEEN  RETRIEVED 


© 


5/Sye tem  informs  user  how  many  documents 
Rave  been  retrieved^ asks  PRINT  SOME? 


(^T)Vser  answers  system's  question  in  (5). 


NO 


_r 


© 


d- YES 


© 


JTySystem  asks  user  to  specify  desired 
information  categories  by  answering  questions] 
about  each  and  asks  user  to  answer  YES,  NO, 
ALL,  or  FORGET  to  each  question. _ 


(j)user  .answers  system's  question  in  (7). 


FORGET 


■:  © 


YES  or 
ALL  to  any 
question 


NO  to 
all 

questions 


(  $>)  System  prints  out  the 
desired  information, 
stopping  periodically  to 


(13) System  prints  out  accession  numbers 
for  all  documents  found,  stopping  periodically 
to  ask  MORE 7  .  _ 


' . . 

(19)  User  answers  system’s 

_  -NO  v 

© 

question  in  (9). 

YES 

_ _ * 

V^) System  prints  all 
desired  information  for 
all  documents  found. 


flti)  User  answers  system's 
question  in  (13). 


YES 


jsL. 


fl5)  System  prints 

(l2) System  types 
'•  THAT'S  ALL 

H 

©. 

accession  numbers  for 
all  doc\iments  found. 

-  1 

Figure  b 
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FLOWCHART 

(Fourth-level  Rosponoo  in  Seuantlo  Expansion  of  RETRIEVE  Command) 
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Air  Force  Office  of  Scientific  Research 
Directorate  of  Information  Sciences  ('-H' 
Arlington,  Virginia  22209 
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The  report  briefly  describes  the  goals  of  the  Moore  School  Information 
Laboratory  which  are  primarily  in  the  following  tasks  at  the  system  level: 
specifications  for  machine  storage  of  indexer  aids,  including  lists  of  index  Items, 
synonymic  equivalences,  classification  tables,  and  other  semantic  tools;  organi¬ 
sation  of  disk  file  storage;  study  of  uses  of  graphic  display.  The  report  also 
eummates  the  progress  made  by  the  Laboratory  in  these  tasks. 
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